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1. Introduction 

The nonlinear ABS algorithms solve a nonlinear system of algebraic equations F(x) = 
where F is a function F : R n — > R n in component form fi(x) = 0, fvix) = 0,..,f n (x) = 
0, x € i? n . The ABS algorithms can be viewed as a modification of the Newton method. 
Newon method constructs an iterative sequence of points Xi, i = 1,2, ... by the relation 
Xj+i = Xi + ti, where tj is the solution of the linear system J(xi)ti = —F(xi) or in 
component form a k {xi)ti = —fk( x i)i k = 1, ..,n, where J(xi) indicates the Jacobian 
matrix of F evaluated at Xi, while a k (xi) denotes the k-th row of J evaluated at Xj. The 
set of linear equations a k {xi)ti = —fk(%i), fe = 1, ..,n is solved by the ABS method for 
linear systems after modifying the definition of J and F. The motivation is based on the 
fact that at the k-th. step the ABS algorithms generate the next approximation to the 
■ solution ti using the k-th. equation and the vector ti k which is a solution of the system 

formed by the first k — 1 equations. Since the new approximate point X{ + ti k is expected 
to be closer to the solution x* of F{x) = 0, it can be used to evaluate the k-th. row of J 
and the k-th component of F. The procedure is the following. 

Assing an initial vector xq, set m = 1, 
Q\ . (★) set yi = x m _i, Hi = I, for k = 1 to m compute: 

Pk = H^Zk where E R n is a parameter which gives the type of ABS method, 
0k = fk(yk)/$k, h = pla k (y k ), y k+1 = y k - [3 k p k , H k+1 = H k - H k a k (y k )p{ /5 k , 
let x m = y n +i, 

if the stopping criterion is satisfied, stop; otherwise increment the index m by 1 and return 
to (*). 
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2. The implemented codes 



The ABS codes that we have implemented based on the above algorithm use three choices 
of the available parameter z k that define three well-known ABS methods for the linear 
case. 

The first code, routine nl-huangl, and the second code, routine nl-huang2, use the Huang 
method defined by z k = a k (y k ), and the modified Huang method defined by z k = H]:a k (y k ) 
& nd 5 k =plp k . 

In the routine nl-huangl the matrix H k is updated by formula H k+ \ = H k —H k a k (y k )pJI/5 k . 
In one major iteration (consisting of a sequence of n minor iterates such that system 
J(x)ti = —F(x) is solved) the number of moltiplications is 3/2n 3 for the Huang algorithm, 
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5 / 2n 3 for the modified Huang algorithm and symmetry of is forced by computing only 
the elements on a triangular part of the matrix. The memory requirement is n 2 /2. 
In the routine nl-huang2 the vector pk is computed by the equivalent formula pk = ak{yk)~ 
Pk-iDk-i P k-i a k{yk) in Huang method and p k = s k - Pk-iD^P^Sk, s k = a k (y k ) - 
Pk-iD^P^akiyk) in the modified Huang method, where P k -i = (pi, ..,p k -i), D k -i = 
{Si, .., Sk-i)- In one major iteration the number of moltiplications is n 3 for the Huang 
algorithm, 2n 3 for the modified Huang algorithm, the memory is n 2 . This code requires 
less operations but more memory than nl-huangl. 

In the third code, routine nl-ilu, the parameter choices are the same of the implicit LU 
algorithm with column pivoting, that is Zk = ej where j is such that |ej H k a k {y k )\ = 
max{\ef H k a k {y k )\,l = 1, ..,n}. A major iteration requires n 3 /3 multiplications and n 2 /2 
memory (memory requirement can be reduced to n 2 /4 by using a different implementa- 
tion). 

In a major iteration the number of component function evaluations is n and the number 
of element jacobian evaluation is n 2 for all the codes. 

The jacobian is singular if at least one row k is linearly dependent, in which case in all 
the algorithms the iteration continues setting y k +i = yk- In the theoretical ABS method 
the test for linearly dependence is H k a k = 0, in the present codes the test is done on the 
value of Sk and the zero is substituted by a tolerance t or t* \\a,k\\ where t is given by the 
user. 

The programs have four stopping criteria. The first criterion depends on a measure of the 
residual \\F{ 

•^i) ||oo — eps, the second criterion is based on a measure of the relative distance 
between consecutive iterates — Xj||oo < io^||^j||oo) the third criterion terminates the 

iterations if no progress occurs in decreasing the function after a fixed number n s of steps. 
The last criterion terminates the iterations after a fixed number Umax of steps. The 
parameters t, eps, tol, n s , Umax are given by the user. 

Optionally, if the norm of F is increasing at an iteration i, the implemented algorithms can 
use a line search technique. Setting x = Xj, the line search technique reduces the width of 
the interval between the points and x by 1/2 (the new point is x = {xi-i + x)/2) and 
so on, until a point x is found where the norm of F{x) decreases, or a maximum number 
nhalf of halvings is achieved, where rihaif is given by the user. 
The codes are written in Fortran 77 in single and in double precision. 

3. The numerical experiments 

Some numerical results are given in the following tables. The symbols mod.huangl, 
mod.huang2, implicit lu, refer to the codes nl-huangl, nl-huang2, nl-ilu, the symbols 
m.hual line search, m.hua2 line search, imp.lu line search, mean that the line search tech- 
nique was applied in the algorithms nl-huangl, nl-huang2, nl-ilu, where the function norm 
grows at some iterations. The symbol H-F^oo means the minimum value found by the algo- 
rithm, ^iifiIoc the iteration where H^Hoo was found, it the number of performed iterations, 
time the execution time. The symbols in the brackets have the following meanings: (x) 
the second stopping criterion is verified, (div) divergence, stop because ||-F||oo increases 
during a fixed number of steps, (o) oscillations, stop because there is no improvement in 
the last n s steps. Lack of marks means that the first convergence test is satisfied. 
The experiments are obtained setting the tolerance parameters t = l.e — 6, eps = l.e — 6, 
tol = l.e — 10 for the single precision case and t = l.e — 15, eps = l.e — 15, tol = l.e — 18 
for the double precision case. 
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We have used the following test functions: 

• Rosenbrock function (n = 2 and the extended Rosenbrock function, where, for 
i = l,2....n/2 

hi = 10(x 2 j - a?li-i) 
^o 2l -i = -1-2, x 02l = 1.0 

• Powell singular function with n = 4, where 



/i = xi + 10x 2 
/ 2 = 5 1 /2( X3 _ X4 ) 

/ 3 = (x 2 - 2x 3 ) 2 

/ 4 = 10 1 / 2 (X 1 -X 4 ) 2 

x = (3,-1,0,1) 
• Brown almost linear function 



U = x l + £™=i x, - (n + 1) 

f n = (U? =1 x j )-l 

x 0i = 1/2, i = 1,2, ..,n 

• Schubert Broyden function 
fi = (3 - xi)xi + 1-2x2 

/i = (3 - Xj)xj + 1 - Xj_i - 2x i+ i i = 2, .., n - 1 

/n = (3 Xji)X n + 1 Xji— 1 

x 0i = -1, i = l,2, ..,n 



4. References 
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